CLAIMS 



What is claimed is: 




1 . An-ftiput device tor providing a signal to effect translational and/or rotationa 
movements of an object on a graphical display, comprising: 
a device for capturing video images; 

an input image processor that translates captured videoimages of human arm 
motion into signals that are delivered to an output imae^processor, the input image 
processor programmed to (a) isolate the human fojm from the background in the captured 
10 video image; (b) determine the position and rofovement of the human arms; and (c) 

generate an output signal responsive to)Ke position and/or movement of the human arms; 
and 

an output image processor that is programmed to effect translational and/or 
rotational movement ofan object on a graphical display in response to the signals 
1 5 received from the ^kiput image processor. 



2. yfhe input device of claim 1 wherein the output image processor changes the 
lisplay according to tne perspective ol what a tlyiilg objeeH¥©uld-see iu _ 



20 3. The input device of claim 1 wherein the output image processor generates a 
graphical display of a flying object whose position and motion are responsive to the 
signal output by the input image processor. 
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Aja iethod for g ene rating signals to effect translation^ and/or rotational 
movements of an object on a graphical display using human arm position and movemej 
data, comprising: 

providing an image processor and a device for capturing video images; 

capturing video images and processing those images to isolate a human form from 
a background; 

isolating the arm portions of the human form; 

calculating the arm position and movement daf^; and 

generating a signal responsive to the armjfosition and movement data for 
effecting translational and/or rotational movement of an object on a graphical display. 



5. A method for generating sigjtfals using human arm position and/or movement data, 
comprising: 

providing an image processor and a device for capturing video images; 
1 5 capturing video khages with the device and using the image processor to process 

those images to isolate a human form from a background; 

isolating/die arm portions of the human form from a captured video image using 
the image processor; 

ilculating the arm position and movement data using the image processor; and 
20 / generating a signal responsive to the arm position and movement data using the 
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6. AlfieThnH-ft^gfH^ratiiig gigna]^ to effect translational and/or rotational 



movements of an object on a graphical display using human arm position and/or 
movement data, comprising: 

providing an image processor and a device for capturing a video seqijeflce; 
5 capturing, from the video sequence, a frame that does not includ^ a person; 

isolating a view comprising a foreground subject image vigw by performing an 
algorithm on the video sequence and the frame that does not include the person; 

determining whether the isolated view includes ti*e image of a person; 

determining the horizontal extent of the subject's torso so as to isolate the arm 
1 0 portions of the human form in each captured vLzleo frame; 

computing the arm angles by calculating angles of principle moment of the 
nonzero pixels in the arm portions of tKe video image; and 

generating an arm position^data signal responsive to arm angles for effecting the 
translational and/or rotationaj'movement of an object on a graphical display. 



7. The method/6f claim 6 wherein the step of determining whether the view includes 
a person composes the steps of: 

counting the total number of nonzero pixels in the foreground image; 
ensuring that the total number of nonzero pixels falls within a range defined by a 



20 



"and a maximum threshold number of pixels. 
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8. The method of claim 6 wherein the algomthm in the isolating step involves 
subtracting the frame that does not include a person from the individual frames in the 
video sequence. / 



9. The method of claim 6 wherein the following algorithm is used in the isolating 
step: 

(a) obtain static background YO UO VO frames; 

(b) smooth images YO UO VO using a 5x5 Gaussian convolution; 

(c) obtain current Y U V video frames; 

(d) smooth images Y U V using a 5x5 Gaussian convolution; 

(e) for each pixel in Y, compute Ydif = abs( Y - YO); 

(f) for each pixel in U, compute Udif = abs( U - UO); 

(g) for each pixel in V, compute Vdif = abs( V - VO); 

(h) for each pixel in Ydif Udif Vdif, compute Sum = Ydif + Udif*8 + Vdif*8; 

(i) for each pixel in Sum, compute Foreground = 1 if Sum > Threshold, 0 otherwise; 

(j) erode Foreground using standard erosion morphological filter (to remove any single-pixel 
erroneous measurements, such as caused by salt-and-pepper noise). 



The method of clai mjjwherein the arm position/movement data signals generated 



in the generating step are selected from the group consisting of signals rglatecfto object 
airspeed acceleration, bank angle, and pitch angle. 



1 1 . The method of claims 6 wherein^tfte arm position/movement data signals 
generated in the generating stea^dfe determined with the inclusion of smoothing 
constants. / 



12. A method for generating signals for use in a flight simulator graphical display 
using hjaman arm position data to effect translational and/or rotational movement, 
comp rising: 
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providing a device for capturing video images and an image processor; 

capturing video images with the device/and using the image processor to process 
those images to isolate a human form from ar background; 

isolating the arm portions of th^human form from a captured video image using 
the image processor; / 

calculating arm position and movement data using the image processor; and 

generating a signal responswe to the arm position and movement data using the 
image processor for use in generating the state of a flight simulator graphical display. 

13. The method of claim 12 wherein the flight simulator graphical display includes as 
an object a flying creature that moves wings. 



14. The method of claim 12 wherein the flight simulator graphical display depicts a 
change in perspective of what a flying creature would see. 



5. TTip>mfhft 4nf Hrrim 1 ^ fiirth^r including the ntep of G enerating fla pp in g noi s es 
corresponding to the movement of the wings of the flying creature. 



1 6. The method of claim 1 5 wherein the volupatfof the flapping noises increases with 
an increased rate of captured arm moJ 

1 7. The mejhtfcf of claims 1 5 wherein the flapping noise is triggered when the signed 
tmvM^ of rhFmf^-nfthfi averse ufllie unir-ffflglef; exceed", n pre determined threshold. 
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18. Ati Mriir1p^^»aniifaptiirp PmfinHyj^fT a program of instructions executable by a 
machine, the program of instructions including instructions for 

capturing video images and processing those images to isolate a human form froj; 
a background; 

isolating the arm portions of the human form; 

calculating the arm position and movement data; and 

generating a signal responsive to the arm position and movement data for 
effecting translational and/or rotational movement of an object on a graphical display 

1 9. The article of manufacture of claim 1 8 wherein the signal generated by the 
program of instructions is used to generate ti^e state of a flight simulator graphical 
display. 



15 20. An article of manufacture embodying a program of instructions executable by a 
machine, the program of instructions including instructions for: 

capturing videoimages with the device and using the image processor to process 
those images to isojdte a human form from a background; 

isolatiijgfthe arm portions of the human form from a captured video image using 
20 the image processor; 

calculating the arm position and movement data using the image processor; and 
generating a signal responsive to the arm position and movement data using the 
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21. An article of manufacture embodying a program of instructions executable by a 
machine, the program of instructions including/instructions for: 

capturing, from the video sequenceya frame that does not include a person; 

isolating a view (foreground/subject image) by performing an algorithm on the 
video sequence and the frame that does not include a person; {entire? partial?} 

determining whether the isolated view includes the image of a person; 

determining the horizontal extent of the subject's torso so as to isolate the arm 
portions of the human form ir/a/the/each captured video frame; 

computing the arm/angles by calculating angles of principle moment of the 
nonzero pixels in the arph portions of the video image; and 

generating anyarm position/movement data signal responsive to arm angles for 
effecting the translafional and/or rotational movement of an object on a graphical display. 
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